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Consensus Labeled Random Finite Set Filtering 
for Distributed Multi-Object Tracking 

Claudio Fantacci, Ba-Ngu Vo, Ba-Tuong Vo, Giorgio Battistelli and Luigi Chisci 


Abstract 

This paper addresses distributed multi-object tracking over a network of heterogeneous and geograph¬ 
ically dispersed nodes with sensing, communication and processing capabilities. The main contribution 
is an approach to distributed multi-object estimation based on labeled Random Finite Sets (RFSs) and 
dynamic Bayesian inference, which enables the development of two novel consensus tracking filters, 
namely a Consensus Marginalized ()-Generalized Labeled Multi-Bernoulli and Consensus Labeled Multi- 
Bernoulli tracking filter. The proposed algorithms provide fully distributed, scalable and computationally 
efficient solutions for multi-object tracking. Simulation experiments via Gaussian mixture implementa¬ 
tions confirm the effectiveness of the proposed approach on challenging scenarios. 

Index Terms 

RFS, FIS ST, labeled multi-object Bayes filter, multi-object tracking, sensor networks, consensus. 

I. Introduction 

Multi-Object Tracking (MOT) involves the on-line estimation of an unknown and time-varying number 
of objects and their individual trajectories from sensor data [1|-[[8]|. In a multiple object scenario, the 
sensor observations are affected by misdetection (e.g., occlusions, low radar cross section, etc.) and false 
alarms (e.g., observations from the environment, clutter, etc.), which is further compounded by association 
uncertainty, i.e. it is not known which object generated which measurement. The key challenges in MOT 
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include detection uncertainty , clutter , and data association uncertainty. Numerous multi-object tracking 
algorithms have been developed in the literature and most of these fall under the three major paradigms 
of Multiple Hypothesis Tracking (MHT) j6j, (9), Joint Probabilistic Data Association (JPDA) 0, and 
Random Finite Set (RFS) |7). 

Recent advances in wireless sensor technology inspired the development of large sensor networks con¬ 
sisting of radio-interconnected nodes (or agents) with sensing, communication and processing capabilities 


(TO I. The main goal of such a net-centric sensing paradigm is to provide a more complete picture of the 
environment by combining information from many individual nodes (usually with limited observability) 
using a suitable information fusion procedure, in a way that is scalable (with the number of nodes), 
flexible and reliable (i.e. resilient to failures) Reaping the benefits of a sensor network calls for 
distributed architectures and algorithms in which individual agents can operate with neither central fusion 
node nor knowledge of the information flow in the network GD- 

The wide applicability of MOT together with the emergence of net-centric sensing motivate the 
investigation of Distributed Multi-Object Tracking (DMOT). Scalability with respect to network size, 
lack of a fusion center as well as knowledge of the network topology call for a consensus approach 
to achieve a collective information fusion over the network (nj-goj. In fact, consensus has recently 
emerged as a powerful tool for distributed computation over networks 111], fT2| , including parameter/state 
estimation G3-© Furthermore, a robust (possibly suboptimal) information fusion procedure is needed 
to combat the data incest problem that causes double counting of information. To this end, Chernojf fusion 
also known as Generalized Covariance Intersection 


[ 21 ], 


(that encompasses Covariance 


Intersection |25| , p6| ) or Kullback-Leibler average [20], [[27], is adopted to fuse multi-object densities 
computed by various nodes of the network. Furthermore, it was proven in |26| for the single-object 


case, and subsequently in |28J for the multi-object case, that Chernoff fusion is inherently immune to 
the double counting of information, thereby justifying its use in a distributed setting wherein the nodes 
operate without knowledge about their common information. 

While the challenges in MOT are further compounded in a distributed architecture, the notion of multi¬ 
object probability density in the RFS formulation enables consensus for distributed state estimation to 
be directly applied to multi-object systems [27]-[31|. Indeed, a robust and tractable multi-object fusion 
solution based on Kullback-Leibler averaging, together with the Consensus Cardinalized Probability 
Hypothesis Density (CPHD) filter have been proposed in | [27| . However, this RFS-based filtering solution 
does not provide estimates of the object trajectories and suffers from the so-called “spooky effect ” (32|. 
Note that one of the original intents of the RFS formulation is to propagate the distribution of the set 
of tracks via the use of labels, see |5] p. 135, pp. 196-197], 0 p. 506]. However, this capability was 
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overshadowed by the popularity of unlabeled RFS-based filters such as PHD, CPHD, and multi-Bernoulli 


This paper proposes the first consensus DMOT algorithms based on the recently introduced labeled RFS 
formulation (37). This formulation admits a tractable analytical MOT solution called the 5-Generalized 


Labeled Multi-Bernoulli (5-GLMB) filter [ 38 ] that does not suffer from the “ spooky effect ”, and more im¬ 
portantly, outputs trajectories of objects. Furthermore, efficient approximations that preserve key summary 
statistics such as the Marginalized S-GLMB (M5-GLMB) and the Labeled Multi-Bernoulli (LMB) filters 
have also been developed |39) , [ [40| . In this paper, it is shown that the M5-GLMB and LMB densities 
are algebraically closed under Kullback-Leibler averaging, and novel consensus DMOT M5-GLMB and 
LMB filters are developed. 

The rest of the paper is organized as follows. Section [II] presents notation, the network model, and 


background on Bayesian filtering, RFSs, and distributed estimation. Section III presents the Kullback- 


Leibler average based fusion rules for M5-GLMB and LMB densities. Section [IV] describes the multi¬ 
object Bayesian recursion with labeled RFSs and presents the novel Consensus M5-GLMB and Consensus 
LMB filters with Gaussian Mixture (GM) implementation. Section [V] provides a performance evaluation 
of the proposed DMOT filters via simulated case studies. Concluding remarks and perspectives for future 


work are given in Section VI 


II. Background and problem formulation 


A. Notation 


Throughout the paper, we use the standard inner product notation (/, g) = f f{pc) g(x)dx, and the 
multi-object exponential notation h x = Ylxex h( x )> where h is a real-valued function, with h 0 = 1 by 
convention |7|. The cardinality (or number of elements) of a finite set X is denoted by \X\. Given a set 
S , 1 s(-) denotes the indicator function of S , X(S) the class of finite subsets of S , and S l the i th -fold 
Cartesian product of S with the convention S° = { 0 }. We introduce a generalization of the Kronecker 
delta that takes arguments such as sets, vectors, etc., i.e. 


Sy(X) 4 


1, if X = Y 
0, otherwise 


A Gaussian Probability Density Function (PDF) with mean /i and covariance S is denoted by A /"(•; /i, E). 
Vectors are represented by lowercase letters, e.g. x, x, while finite sets are represented by uppercase letters, 
e.g. X , X; spaces are represented by blackboard bold letters e.g. X, Z, L. 
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Given PDFs p, q and a scalar a > 0, the information fusion © and weighting operators © 

p{x)q(x) 


? li ' I ? 


[41 ] are defined as: 


(p © q) ( x ) = 


(P. 9) 


(a © p) (. x ) = 


A W)] C 


(P“> 1) ’ 

For any PDFs p, q, h, and positive scalars a, /3, the fusion and weighting operators satisfy: 

(p © q) © h = p@(q@h)=p®q®h 

p® q = q®p 

(a f3) Q p = a®(/3®p) 

1 Op = p 

a © (p © q) = (a © p) © (cr © g) 

(a + /3)0p = (a © p) © (0 © g) 


( 1 ) 

( 2 ) 


P. A 
P.B 
P.C 
P.D 
P.E 
P.F 


B. Network model 



Fig. 1. Network model 

The network considered in this work consists of heterogeneous and geographically dispersed nodes 
having processing, communication and sensing capabilities as depicted in Fig. [I] From a mathematical 
viewpoint, the network is described by a directed graph Q = (A/*, A) where N is the set of nodes and 
A C J\f x J\f the set of arcs, representing links (or connections). In particular, (i,j) G A if node j 
can receive data from node i. For each node j G Af, J\f^ = {i G N : (i, j) G A} denotes the set of 
in-neighbours (including j itself), i.e. the set of nodes from which node j can receive data. 

Each node performs local computations, exchanges data with the neighbors and gathers measurements 
(e.g., angles, distances, Doppler shifts, etc.) of objects present in the surrounding environment (or 
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surveillance area). The network of interest has no central fusion node and its agents operate without 
knowledge of the network topology. 

We are interested in networked estimation algorithms that are scalable with respect to network size, 
and permit each node to operate without knowledge of the dependence between its own information and 
the information from other nodes. 

C. Distributed Single-Object Filtering and Fusion 

For single-object filtering, the problem of propagating information throughout a sensor network (A/*, A) 
with neither central fusion node nor knowledge of the network topology can be formalized as follows. 

The system model is described by the following Markov transition density and measurement likelihood 
functions 

fk\k-i{xk\xk-i) (3) 

9k\ z( k\ x k) G V (4) 

The measurement at time k is a vector Zk = (f k \ ■ ■ ■ ■ '^) of measurements from all |.V| sensors, 

which are assumed to be conditionally independent given the state. Hence the likelihood function of the 
measurement Zk is given by 

9k(zk\xk ) = H g^\z^\x k ). (5) 

ieN 

Let Pk\k-i('\ z i:k-i) denote the prediction density of the state at time k given z\±-\ = (zi,..., Zk- 1 ), 
and similarly Pk('\zi:k) the posterior density of the state at time k given z\± = (zi,..., zf). For simplicity 
we omit the dependence on the measurements and write the prediction and posterior densities respectively 

as Vk\k-\ and p k . 

In a centralized setting, i.e. when the central node has access to all measurements, the solution of the 
state estimation problem is given by the Bayesian filtering recursion starting from a suitable initial prior 

Po- 

Pk\k-i(x k ) = (fk\k-i(xk\ ■) ,Pk- 1> , (6) 

Pk{xk) = {gk(zk\-)®Pk\k-i) (Xk)- (7) 

(i) 

On the other hand, in a distributed setting each agent i G N updates its own posterior density p y k J by 
appropriately fusing the available information provided by the subnetwork J\fA (including node i). Thus, 
central to networked estimation is the capability to fuse the posterior densities provided by different nodes 
in a mathematically consistent manner. In this respect, the information-theoretic notion of Kullback-Leibler 


Average (KLA) provides a consistent way of fusing PDFs |20|. 
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Given the PDFs pW, i G X, and normalized non-negative weights (i.e. non-negative weights that 
sum up to 1), i G X, the weighted Kullback-Leibler Average (KLA) p is defined as 

p = argmin uj^Dkl {p || (8) 

%ClX 

where 

Dkl (p || P (i) ) = Jp(x) rf® (9) 

is the Kullback-Leibler Divergence (KLD) of p 1 - 1 ' from p. In [ 20 ] it is shown that the weighted KLA in 
is the normalized weighted geometric mean of the PDFs, i.e. 

n[» (,, w]"“ 

© o p^fx). 


p(x ) = 


%ClX 


[n[p {i H x ) 

J iex 






( 10 ) 


Indeed, © defines the well-known Chemoff fusion rule (21), [22']. Note that in the unweighted KLA 
wW = 1/|2|, i.e. 


p 




iex 


( 11 ) 


Remark 1. The weighted KLA of Gaussians is also Gaussian [20]. More precisely, let ($, q) = (E _1 , E _1 /i) 
denote the information (matrix-vector) pair associated with Af (•; /i, E), then the information pair (<F, g) 
of the KLA p(-) = E) I s the weighted arithmetic mean of the information pairs ($W,gW) of 

^(•) = J\f (•; //W, EW). This is indeed the well-known Covariance Intersection fusion rule [25]. 


p y 

Having reviewed the fusion of PDFs via KLA, we next outline distributed computation of the KLA 
via consensus. 


D. Consensus on PDFs 

The idea behind consensus is to reach a collective agreement (over the entire network), by allowing 
each node i G J\f to iteratively update and pass its local information to neighbouring nodes [11]. Such 
repeated local operations provide a mechanism for propagating information throughout the whole network. 

In the context of this paper, consensus is used (at each time step k) to perform distributed computation 

(i) 

of the collective unweighted KLA of the posterior densities p k ’ over all nodes i G JV. 

Given the consensus weights w^d) g [0,1] relating agent i to its in-neighbour nodes j G J\f^\ satisfying 
= 1, suppose that, at time k, each agent i starts with the posterior p^ k as the initial iterate 
p k q, and computes the n th consensus iterate by 

Pkl= © i) 

jeAfw 


( 12 ) 
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Then, using the properties of the operators © and ©, it can be shown that [20| 

p£, = © (“Pep?) 03) 

where is the (z, j)-th entry of the square matrix ft n , and ft is the consensus matrix with (z, j)-th 
entry given by (it is understood that is omitted from the fusion whenever cJn^ = 0). 

Notice that ( [T3] ) expresses the local PDF in each node z at consensus iteration rz as a weighted geometric 
mean of the initial local PDFs of all nodes. More importantly, it was shown in |lfj, ]T2| that if the 
consensus matrix ft is primitive (i.e. with all non-negative entries and such that there exists an integer 
m such that ft 171 has all positive entries) and doubly stochastic (all rows and columns sum up to 1), then 
for any z, j G A f 


lim 

n-»oo n 


1 

M' 


(14) 


In other words, if the consensus matrix is primitive and doubly stochastic, then the consensus iterate of 
each node approaches the collective unweighted KLA of the posterior densities over the entire network 
as the number of consensus steps tends to infinity © (20). 

A necessary condition for ft to be primitive [T6| is that the associated network Q be strongly connected, 
i.e. for any pair of nodes z, j e A f there exists a directed path from z to j and vice versa. This condition is 
also sufficient when > o for all z G M and j G A Further, when Q is undirected (i.e. whenever 
node z receives information from node j, it also sends information to j), choosing the Metropolis weights 

w (*,i) = < l+max{|V( i )|J.VW)|}’ 1 ^ (15) 

k 1 - EieAT(^)\{i} > * € V, j = * 

ensures that ft is also doubly stochastic (T2|, (T§. 

In most tracking applications, the number of objects is unknown and varies with time, while measure¬ 
ments are subjected to misdetection, false alarms and association uncertainty. This more general setting 
can be conveniently addressed by a rigorous mathematical framework for dealing with multiple objects. 
Such a framework is reviewed next, followed by the extension of the consensus methodology to the 
multi-object realm. 


E. Labeled Random Finite Sets 


The RFS formulation of MOT provides the notion of multi-object probability density (for an unknown 


number of objects) [42] that conceptually allows direct extension of the consensus methodology to multi¬ 


object systems. Such a notion of multi-object probability density is not available in the MHT or JPDA 
approaches 0, ©, 0. 





From a Bayesian estimation viewpoint the multi-object state is naturally represented as a finite set, 
and subsequently modeled as an RFS p4| . In this paper, unless otherwise stated we use the Finite Set 
STatistics (FISST) notion of integration/density to characterize RFSs 0 - While not a probability density 
0, the FISST density is equivalent to a probability density relative to an unnormalized distribution of a 
Poisson RFS [42]. 

Let L be a discrete space, and C : XxL L be the projection defined by C((x,l)) = L Then £(x) 
is called the label of the point x G XxL, and a finite subset X of XxL is said to have distinct labels if 
and only if X and its labels £(X) = {£(x) : x G X} have the same cardinality. We define the distinct 
label indicator of X as A(X) A 5| X |(|£(X)|). 

A labeled RFS is an RFS over XxL such that each realization has distinct labels. These distinct labels 
provide the means to identify trajectories or tracks of individual objects since a track is a time-sequence 


of states with the same label [37]. The distinct label property ensures that at any time no two points can 
share the same label, and hence no two trajectories can share any common point in the extended space 
XxL. Hereinafter, symbols for labeled states and their distributions are bolded to distinguish them from 
unlabeled ones, e.g. x, X, 7r. 


1) Generalized Labeled Multi-Bernoulli (GLMB): A GLMB [ 37 ] is a labeled RFS with state space X 
and (discrete) label space L distributed according to 

x 


P 


(0 


(16) 


7r(X) = A(X)5>tt>(£(X)) 

where S is a given discrete index set, each is a PDF on X, and each w^\L) is non-negative 

with 

E E w®{L) = 1 . (17) 

Lei\ L) 


Each term in the mixture (16) consists of: a weight w (£)(£(X)) that only depends on the labels £(X) 
of the multi-object state X; a multi-object exponential [p^] X that depends on the entire multi-object 
state. 

The cardinality distribution and intensity function (which is also the first moment) of a GLMB are 
respectively given by 


Pr(|X|=n) = £ £ 8 n (\I\)w®(I), 

£es ieJ\ l) 


(18) 

( 19 ) 
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The GLMB is often written in the so-called 5-GLMB form by using the identity 


p 


(0 


i x 


( 20 ) 


7T(X) = A(X) J2 

(L 0ej(L)xE 

For the standard multi-object system model that accounts for thinning, Markov shifts and superposition, 
the GLMB family is a conjugate prior, and is also closed under the Chapman-Kolmogorov equation p7| . 
Moreover, the GLMB posterior can be tractably computed to any desired accuracy in the sense that, given 
any e > 0, an approximate GLMB within e from the actual GLMB in L\ distance, can be computed (in 
polynomial time) p8|. 


2) Marginalized 5-GLMB (M5-GLMB): An M5-GLMB 39 ] is a special case of a GLMB with S = 
J^L) and density: 

lX 


tt(X) = A(X) J2 W(X)MJ)[p(-;/)] 3 
ieJ\ l ) 

= A (XH£(X))[p(-;£(X)f. 


( 21 ) 

( 22 ) 


An M5-GLMB is completely characterized by the parameter set {(w(I) ,p(-;/)) : / G ^(L)}, and for 
compactness we use the abbreviation 7r = {(w(I) ,p( m ] l) f° r its density. 

In [39| , an M5-GLMB of the form ( [21] ) was proposed to approximate a 5-GLMB of the form ( [20] ), by 
marginalizing (summing) over the discrete space S, i.e. setting 






p(x, l\ I) = -yy X] W (?) W ' 


u;(7) 


(23) 


(24) 


Moreover, using a general result from |43| it was shown that such M5-GLMB approximation mimimizes 


the KLD from the 5-GLMB while preserving the first moment and cardinality distribution (391. The M5- 
GLMB approximation was used to develop a multi-sensor MOT filter that is scalable with the number 
of sensors [3^|. 

3) Labeled Multi-Bernoulli (LMB): An LMB (37j is another special case of a GLMB with density 

7r(X) = A(X) [1 - r ] MV:(x) [1 M r] £(x) p x (25) 

An LMB is completely characterized by the (finite) parameter set {(r(^) ,p(*, #)) : £ G M}, where M C L, 
r{t) G [0,1] is the existence probability of the object with label £, and p(-,£) is the PDF (on X) of the 
object’s state. For convenience we use the abbreviation 7r = {(r(£) M for the density of an 


LMB. In 1401, an approximation of a 5-GLMB by an LMB with matching unlabeled first moment was 
proposed together with an efficient MOT filter known as the LMB filter. 
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III. Information Fusion with labeled RFS 

In this section, it is shown that the M5-GLMB and LMB densities are algebraically closed under KL 
averaging, i.e. the KLAs of M5-GLMBs and LMBs are respectively M5-GLMB and LMB. In particular 
we derive closed form expressions for KLAs of M5-GLMBs and LMBs, which are then used to develop 
consensus fusion of M5-GLMB and LMB posterior densities. 


A. Multi-Object KLA 

The concept of probability density for the multi-object state allows direct extension of the KLA notion 
to multi-object systems [(27J. 

Given the labeled multi-object densities 7i*W on X^XxL), i G X, and the normalized non-negative 
weights cjW, i G X (i.e. non-negative weights that sum up to 1): 

1) The weighted KLA: n is defined by 


7T = arg mm 

7T 


in Dkl || 

iez 


where 


Dkl(* || 7T W ) = /.(X) 


log 


TT(X) 


5X 


(26) 


(27) 


,irW(X) 

is the KLD of 7 r : 0 from 7r |7j, |35j, and the integral is the FISST set integral defined for any function 

/ on.F(XxlL) by 

[ f(X)8X = £ [f({(x i,Xi),..., (xi,£i)}) d(x i, ...,Xi). (28) 

J i =o 

Note that the integrand /(X) has unit of K~ l x l, where K is the unit of hyper-volume on X. For 
compactness, the inner product notation (f,g) will be used also for the set integral ff(X)g(X)SX, 
when g(X) has unit independent of |X|. 

2) The normalized weighted geometric mean: is defined by 

n p'txf"’ 


®( a ,»0 *«>) = 


iez 


iez 


Note that since the exponents i G X, sum up to unity, the product in the numerator of d29b has 


/ np’w 

iez 


5X 


(29) 


unit of K l x l, and the set integral in the denominator of (29) is well-defined and unitless. Hence, the 


normalized weighted geometric mean ( [29] ), originally proposed by Mahler in (23]| as the multi-object 
Chemoff fusion rule, is well-defined. 
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Similar to the single object case, the weighted KLA is given by the normalized weighted geometric 


mean. 


Theorem 1. [27] - Given multi-object densities i rW, i G X, and normalized non-negative weights 
i G X, 

arg min Y^DkL || 70 7T^y (30) 

iez iez 

Note that the label space L has to be the same for all the densities i rW for the KLA to be well- 
defined. In [28, Theorem 5.1], it has been mathematically proven that, due to the weight normalization 


= 1, the weighted geometric mean (30) ensures immunity to the double counting of information 


irrespective of the unknown common information in the densities 


In [271, it was shown that Poisson and independently identically distributed cluster (IID-cluster) RFSs 
are algebraically closed under KL averaging. While the GLMB family is algebraically closed under the 
Bayes recursion for the standard multi-object system model and enjoys a number of useful analytical 
properties, it is not algebraically closed under KL averaging. Nonetheless, there are versatile subfamilies 
of the GLMBs that are algebraically closed under KL averaging. 


B. Weighted KLA of M5-GLMB Densities 

The following result states that the KLA of M5-GLMB densities is also an M5-GLMB density. The 
proof is provided in Appendix A. 

Proposition 1. Given M5-GLMB densities = {(u;W(/),pW(-; I))}i£j\h)> ^ G X, and normalized 
non-negative weights i G X, the normalized weighted geometric mean 7f, and hence the KLA, is an 
M5-GLMB given by: 

Tf = {(w(L),p(-,L))} Lem (31) 


where 


w(L) = 


npm)""’ /n^w 

iez iez 




lL 


dx 




JCL iez 


J)j dx 


-I J 


L iez 




p(-,C;L) = 


iez 


,(i) 


j n(^ ^ 

ieZ 


,(i) 

L )) dx 


(32) 


(33) 
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Remark 2. The component (w(L) ,p(-; L)) of the KLA M5-GLMB can be rewritten as 


w(L) oc /ll( ;,W ( a; ’'; L 

iex iex 

|>(-;L) = ® ( W W0p«(.;L)) 


(i) 


-iL 


)J dx 


(34) 

(35) 


where (35) is indeed the Chemoff fusion rule for the single-object PDFs |25l. Note also from (34) and 


(35) that each M5-GLMB component (w(L) ,p(-; L)) can be independently determined. Thus, the overall 
fusion procedure is fully parallelizable. 


C. Weighted KLA of LMB Densities 

The following result states that the KLA of LMB densities is also an LMB density. The proof is 
provided in Appendix B. 

Proposition 2. Given LMB densities = {(r^(£),p^(•,£))} l, i E X, and normalized non-negative 
weights i G I, the normalized weighted geometric mean n, and hence the KLA, is an LMB given 
by: 


7T = {(r(f) ,p(-,£))} eeh 


(36) 


where 


r (£) 


J ieX 


— r^(£)^ + j\fr^ l \£)p^ l \x, £)j dx 

iex iex 

PM) = ©(“> (0 ©P (0 M)) • 


(37) 


(38) 


Remark 3. Similar to the KLA of M5-GLMBs, ( [38] ) is indeed the Chernoff fusion rule for the single¬ 
object PDFs [251. Note from ( [37] ) and (38) that each LMB component (r(£) ,p (-,£)) can be independently 
determined. Thus, the overall fusion procedure is fully parallelizable. 


D. Consensus Fusion for Labeled RFSs 

Consider a sensor network J\f with multi-object density n W at each node z, and non-negative consensus 
weights relating node i to nodes j E such that co' 77) = i_ The global KLA over 
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the entire network can be computed in a distributed and scalable way by using the consensus algorithm 
1201, [27 Section III.A]. Starting with 7 Tq ^ = 7i*W, each node i G J\f carries out the consensus iteration 


7T« = 

# * r) 


© (" w> 


© 7T, 


(i) 

n— 1 


je Afw 


(39) 


As shown in (27], Section III-B], the consensus iteration ([39]) —which is the multi-object counterpart 
of equation © —enjoys some nice convergence properties. In particular, if the consensus matrix is 
primitive and doubly stochastic, the consensus iterate of each node in the network converges to the global 
unweighted KLA of the multi-object posterior densities as n tends to infinity. Convergence analysis for 
the multi-object case follows along the same line as in [16], [20] since x L) is a metric space Q- In 
practice, the iteration is stopped at some finite n. Further, as pointed out in |^, Remark 1], the consensus 
iterations ([39]) always generate multi-object densities 7r n that mitigate double counting irrespectively of 
the number n of iterations. 


Starting with 5-GLMBs, the consensus iteration ( [39] ) always returns M5-GLMBs, moreover the M 5- 
GLMB parameter set can be computed by the M5-GLMB fusion rules ( [34] ) and ( [35] ). Similarly, for LMBs 
the consensus iteration ( [39] ) always returns LMBs whose parameter set can be computed by the LMB 
fusion rules (37) and (38). The fusion rules ( [35] ) and ( [38] ) involve consensus of single-object PDFs. 

A typical choice for representing each single-object density is a Gaussian Mixture (GM) ] |44) , (45). 
In this case, the fusion rules ( [35] ) and ( [38] ) involve exponentiation and multiplication of GMs where the 
former, in general, does not provide a GM. Hence, in order to preserve the GM form, a suitable approxi¬ 
mation of the GM exponentiation has to be devised. The in-depth discussion and efficient implementation 
proposed in (27} Section III.D] for generic GMs can also be applied to the location PDF fusion ( [35] ) and 
Considering, for the sake of simplicity, the case of two GMs 

Ni 

Pi(x) = aijJ\T (x; mj, Pi j) 

j= 1 


for i G {a, &}, (35) and (38) can be approximated as follows: 


p(x) = 


N a N b 

EE a jk J\f (x-,p jk ,P jk ) 

j=lk=l 

Na N b 

j=lk =1 


(40) 
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where 


Pjk ~ 


uP aj + (! _ U ) P l 


-1 

b,k 


1 -1 


^jk 


= P 


jk 


“ P ajVa,j + (1 - u)P bt £n btk 


-1 , 


&jk — ^a,j ®b,k "> Pa,j) ^ 5 Pb,k) N ( f^a,j l^b^ki^i 


1 a,3 
i0 


+ 


b,k 


1 — (jJ 


P(u,P)± 


[det(27rPo; x )] 


(41) 

(42) 

(43) 

(44) 


[det(27rP)]^ 

The fusion ( |40| ) can be extended to \J\f\ > 2 agents by sequentially applying the pairwise fusion 
rule (40 )-([44|) \AT\ — 1 times. By the associative and commutative properties of multiplication, the 
ordering of pairwise fusions is irrelevant. Notice that (|40])-(|44|) amounts to performing a Chernoff 
fusion on any possible pair formed by a Gaussian component of agent a and a Gaussian compo¬ 
nent of agent b. Moreover, the coefficient of the resulting (fused) component includes a factor 
N (l^aj ~ Hb,k] 0, l o~ x P a j + (1 — c o)~ 1 P\ ) ^k) that measures the separation of the two fusing components 


(/i a?J , P a j) and (/jLb,k, Pb,k )• Th e approximation (40)-(44) is reasonably accurate for well-separated Gaus¬ 
sian components but might easily deteriorate in presence of closely located components. In this respect, 


merging of nearby components before fusion has been exploited in (271 to mitigate the problem. Further, 
a more accurate, but also more computationally demanding, approximation has been proposed in (46j. 

The other common approach for approximating a single object PDF p(-) is via particles , i.e. weighted 
sums of Dirac delta functions, which can address non-linear, non-Gaussian dynamics and measurements 
as well as non-uniform field of view. However, computing the KLA requires multiplying together powers 
of relevant PDFs, which cannot be performed directly on weighted sums of Dirac delta functions. While 
this problem can be addressed by further approximating the particle PDFs by continuous PDFs (e.g. GMs) 
using techniques such as kernel density estimation (30| , least square estimation (47) , (48) or parametric 
model approaches (49) , such approximations increase the in-node computational burden. Moreover, the 
local filtering steps are also more resource demanding compared to a GM implementation. Hence, at this 
developmental stage, it is more efficient to work with GM approximations. 


IV. Consensus DMOT 

In this section, we present two novel fully distributed and scalable multi-object tracking algorithms 
based on Propositions [I] and [2] along with consensus (HI & (16), (20) to propagate information 
throughout the network. 















15 


A. Bayesian Multi-Object Filtering 

We begin this section with the Bayes MOT filter that propagates the multi-object posterior/filtering 
density. In this formulation the multi-object state is modeled as a labeled RFS in which a label is an 
ordered pair of integers £ = (fc, i), where k is the time of birth, and i G N is a unique index to distinguish 
objects bom at the same time. The label space for objects bom at time k is = {k} x N. An object 
bom at time k has, therefore, state x G XxL&. Hence, the label space for objects at time k (including 
those born prior to fc), denoted as L 0: fc, is constructed recursively by L 0: fc = Lq^-i UL k (note that Lq^-i 
and are disjoint). A multi-object state X at time k, is a finite subset of XxL 0: fc. For convenience, we 
denote L_= B = L&, and L = L_ U B. 

Let 7Vk denote the multi-object filtering density at time k, and the multi-object prediction 

density (for compactness, the dependence on the measurements is omitted). Then, starting from 7To, the 
multi-object Bayes recursion propagates 7T& in time according to the following update and prediction 0, 

m 

^k\k— 1 (^fc) k\k— 1 | * ) 5 K k -1 ( ’ ) ^ 5 (45) 

7Tjfe(X fe ) = (3jfe(Z fe | •) © 7r fc | A ._ 1 ( -)) (Xfc) , (46) 


where // c |/ c _i( • | •) is the multi-object transition density from time k — 1 to time k, and #&( • | •) is 
the multi-object likelihood function at time k. The multi-object likelihood function encapsulates the 
underlying models for detections and false alarms while the multi-object transition density encapsulates 
the underlying models of motion, birth and death. The multi-object filtering (or posterior) density captures 
all information on the number of objects, and their states [[7J. 

Note that the recursions (|45])-(|46]) are the multi-object counterpart of ([6])-([7]), which admit a closed form 
solution, under the standard multi-object system model, known as the GLMB filter |37| (see also (38]| for 
implementation details). However, the GLMB family is not closed under KL averaging. Consequently, 
we look towards approximations such as the M5-GLMB and LMB filters for analytic solutions to DMOT. 


B. The MS-GLMB Filter 

In the following we outline the prediction and update steps for the M5-GLMB filter. Additional details 
can be found in [38]|. 

1) MS-GLMB Prediction: Given the previous multi-object state X^_i, each state (xk-u£ k - 1) £ X^-i 
either continues to exist at the next time step with probability Ps(xk-i,£k-i) an d evolves to a new state 
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(xk,£k) with probability density fk\k-i( x k\ x k-h or dies with probability 1 — Ps(xk~i,^k-i)- The 

set of new objects born at the next time step is distributed according to the LMB 

/b(X) = A(X) [1 - r B f\ c W [i B rB \ c W \p B f . (47) 


It is assumed that Pb(’J) ^ PB( m ,j) when l ^ j. Note that /#(X) = 0 if X contains any element x 
with C (x) ^ B. The multi-object state at the next time X is the superposition of surviving objects and 


new born objects, and the multi-object transition density can be found in [ 37 Subsection IV.D]. 


Remark 4. The LMB birth model assigns unique labels to objects in the following sense. Consider two 
objects bom at time k with kinematic states x and y. In birth models such as labeled Poisson (37), x 
could be assigned label (fc, 1) and y label (fc, 2), i.e. the multi-object state is {(x, (fc, 1)), (y, (fc, 2))}, or 
conversely x assigned label (fc, 2) and y label (fc, 1), i.e. the multi-object state is {(x, (fc, 2)), (y, (fc, 1))}. 
Such non-uniqueness arises because the kinematic state of an object is generated independently of the 
label. This does not occur in the LMB model because an object with label £, has kinematic state generated 
from pb(-,£). If kinematic states x and y are drawn respectively from pb(', (fc, 1)) and pb(-, (&, 2)), then 
the labeled multi-object state is uniquely {(x, (fc, 1)), (y, (fc, 2))}. 


Given the M5-GLMB multi-object posterior density 7Tk-i = {(wfc_i(/) ^))}/gjf(l_L the multi- 

object prediction density is the M6-GLMB 7r fc |fc-i = {(u>fc|fc-i(-0 -O)}/^), where 

w fc|fc-i(-0 = [1 - r B ] InM w^\l fl L_) 


Pk\k-i{x,l;I) = l B (£)p B (x,£) + l h _(£)p s (x,£-,I) 


4'’<o = K] E[‘- f 


T 5 W 


J-L 


Wk-l(J) 


jdl 


p s (x,£;I) = 


P ( s\e) = (P S (;t),Pk-iMl)) 


(PsMfk 

Ps\t) 


(48) 

(49) 

(50) 

(51) 

(52) 


2) M8-GLMB Update: Given a multi-object state X&, each state (x&,^) E X& is either detected 
with probability Pd (x&,^) and generates a measurement z with likelihood y^(z|x^, £&), or missed with 
probability 1 — Pn(xfc,4)- The multi-object observation Z& = { 2 : 1 ,..., is the superposition of 

the detected points and Poisson clutter with intensity function k. Assuming that, conditional on X&, 
detections are independent, and that clutter is independent of the detections, the multi-object likelihood 
is given by (37} Subsection IV.D] 

gk(Zk\X.k) oc E hM-;0)] Xfc (53) 

eee(C(x k )) 
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where ©(/) is the set of mappings 6 : / —I {0,1,..., such that 6{i) — 6(i' ) > 0 implies i = 

and 


^z k {x,t,6) = 


Pp(x,e) g k (z e ^)\x,£) 

«M)) 

1 — Pd(x,£) , 


, if 0(f) > 0 
if 0(f) = 0 


Note that an association map 0 specifies which tracks generated which measurements, i.e. track i generates 
measurement zq ^ G with undetected tracks assigned to 0. The condition “0(i) = 0(i') > 0 implies 
i = i h \ means that, at any time, a track can generate at most one measurement, and a measurement can 
be assigned to at most one track. 

Given the M5-GLMB multi-object prediction density 7r,,| / ._i = {(w fc |fc_i(I) ,Pk\k-i(-'J))}ietf 7 L), the 
M5-GLMB updated density is given by 7T& = {(wk(I) ^))}/<ejf(L)» where 


w k{i) = Y 


w 


( 1 , 0 ) 


Pk(x,t,I ) = 


6 >ee(J) 

MI 

■^(i) 




0eG(i) 


(1,0) l T\ \ I (p0) / \ j 

OC w fc | fc _i(/) M (•) 

= (pfc|k-iM;-0,^z*(-,f; 0)) 

(0), . rN Pk\k-i{x,£]I)ip Zk {x,£-,e) 

* ^ —' 


(54) 

(55) 

(56) 

(57) 

(58) 


Note that the exact multi-object posterior density is not a M(5-GLMB, but a 5-GLMB. The M(5- 
GLMB update approximates the posterior density by a M5-GLMB that preserves the posterior PHD and 
cardinality distribution. 

A tractable suboptimal multi-object estimate can be obtained from the posterior M5-GLMB 7 T/- = 
{(wk(I) ,Pk(-'i I))}ieJ\ l) as follows: first determine the maximum a-posteriori cardinality estimate N* 
from 


Pr(|X| = n)= 51 <$ n (|J|) «;*(/); (59) 

then determine the label set /* with highest weight Wk(I*) among those with cardinality TV*; and finally 
determine the expected values of the kinematic states from Pk(-,£] /*), ^ G /*. Alternatively, one can 
determine the set /* of labels with the N* highest existence probabilities J2ieT( l) 1 i(£) w k(I)\ and then 
the expected values of the kinematic states from ^ £ /*. 

In addition to the generality of the tracking solution, the consideration of label-dependent Ps and Pd 
are useful in some applications. For instance, in live cell microscopy the survival probability of a cell is 
also a function of its age. This can be accommodated by a label-dependent Ps because the label contains 
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the time of birth and the age of a labeled state can be determined by subtracting the time of birth from 
the current time. In some trackers, a track is considered to begin when it is first detected, by convention. 
In this case, label-dependent Pd would be able to capture this assumption, since the label provides the 
time of birth. 


C. Consensus M5-GLMB Filter 


This subsection details the Consensus M5-GLMB filter using a Gaussian mixture implementation. 
Each node i E J\f of the network operates autonomously at each sampling interval k, starting from its 
own previous estimates of the multi-object distribution with PDFs Ml E /, / E ^(L), 

represented by Gaussian mixtures, and producing, at the end of N consensus iterations, its new consensus 
multi-object distribution 7i*W = 7r^. 

The steps of the Consensus M5-GLMB filter over the network A f are given as follows. 

1) Each node i E J\f locally performs an M5-GLMB prediction and update. The details of these two 
procedures are described in the previous subsections. 

2) At each consensus step, node i transmits its data to neighbouring nodes j E Upon 

receiving data from its neighbours, node i carries out the fusion rule of Proposition [I] over its in¬ 
neighbours A/W, i.e. performs (39) using information from AA merging operation for each of 
the PDFs is applied to reduce the joint communication-computation burden for the next consensus 
step. This procedure is repeatedly applied for a chosen number N > 1 of consensus steps. 

3) After consensus, an estimate of the multi-object state is obtained via the procedure described in 
Table HI 


The operations executed locally by each node i E AT of the network are summarized in Table [T| 

We point out that in the algorithm of Table [I| each single object state lives in the space X x L 0 : a; and 
the multi-object state space at time k, x L 0: fc), is the same for all nodes. This is fully consistent 
with the fusion rule of Theorem 1 and the fusion rule for M5-GLMBs. 

In implementation, each component of the M5-GLMB, also known as a hypothesis, is indexed by an 
element of ^(Lq^), i.e., a set of labels. Since the cardinality of the label space L 0: fc increases with time, 
each node performs a pruning of the hypotheses (for instance by removing those with low weights so 
that the total number of hypotheses never exceed a fixed number / max ). Hence, at time k each node i 
has a density containing at most / max components with indices in C P(L 0:k ), and the weights of 

the remaining components, i.e. those in ^(Lq^) \ ij^, are set to zero. As a result, when the densities of 

(i) (i) 

nodes i and j are fused, only the common components, i.e those belonging to I y k J n I): have non-zero 
weights. 
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TABLE I 

Consensus Marginalized (5-GLMB Filter 


procedure Consensus M£-GLMB(Node i . Time k ) 
Local Prediction 

Local Update 
Marginalization 
for n — 1,..., N do 

Information Exchange 
Fusion over A/' (i) 

Merging 
end for 

Estimate Extraction 

end procedure 


> See subsection IIV-B 1 1 

> See subsection IIV-B 21 

> See eqs. ([54|-([58]> 


> See eqs. < [34] ) and ( [35] ) 
> See (44) Table II, Section III.C] 


> See algorithm in Table [TT| 


TABLE II 

M^-GLMB Estimate Extraction 


Input: ir k = {(w k (I) ,p k (-; 4 

Output: X* 
for c = 1 ,..., do 

p(c) m Sc(\i\)w k (i) 

IET( L) 

end for 

N* — arg max p(c) 

c 

T* (I) 

1 — arg max w) ' 

X* = j(4*,.£*): t G /*, x* = argmaxpfc(x,^*; /*)| 


Remark 5. In [5(| it has been shown that the centralized M5-GLMB filter features linear complexity in 
the number of sensors. As far as consensus M5-GLMB is concerned, each node has to carry out local 
prediction and local update, whose computational complexity is clearly independent of the number of 
nodes (sensors), and the consensus task (i.e. repeated KLA fusion over the subset of in-neighbors) which 
requires in the order of N I max d computations, d being the node in-degree. 
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D. The LMB Filter 


As suggested by its name, the LMB filter propagates an LMB multi-object posterior density forward 
in time (40). It is an approximation of the 5-GLMB filter ['37), (38). 

1) LMB Prediction: Given the LMB multi-object posterior density 7r&_i = 
the multi-object prediction density is the LMB (40) 

^k\k-l = {(rsW ,ps(-,t))}teh- U ,PB(-,t ))} te B ( 6 °) 

where 


rs(t) = (Ps(-,t),Pk-i(-,r)) n-iit) 

( f \_ (Ps(-,t)fk\k-i(x\-,t),Pk-iM) 
/M '' j “ (Ps(;t),Pk i(--0) 

2) LMB Update: Given the LMB multi-object prediction density 7r k \ k _i = 
the LMB updated density is given by 7v k = {(r k (£) ,p k (-, £))}ieh, where 


(61) 

(62) 

{ipk\k—l{^) 5 Pk\k —1 (*? 


r k{p> = J2 l i^) w k\ I ) 

(/,9)6J(L)x9(/) 

1 ^ - — M, 


Pk{x,i) = 


w k\ T ) K 

Pk\ x ^) = 


rk{P) 


LI 


(/, 0 )eJ r (L)x©(/) 


[1 -^|fc-i(-)] LV [lLr fc | fc _i] 


Pfc|fc-i(M) ^zJ^AO) 


i> { z k (P) = (Pk\k~i(-J)^z k (-J-,0)) . 


(63) 

(64) 

(65) 

( 66 ) 

(67) 


Note that the exact multi-object posterior density is not an LMB, but a GLMB. The LMB update 
approximates the GLMB posterior by an LMB that matches the unlabeled PHD. The reader is referred 
to (40) for an efficient implementation of the LMB filter. 


E. Consensus LMB Filter 

This subsection describes the Consensus LMB filter using a Gaussian mixture implementation. The 
steps of the Consensus LMB filter are the same as the Consensus M5-GLMB tracking filter described in 
section [TV-Cl with the LMB prediction and update in place of those of the M5-GLMB. Each node i G Af 


of the network operates autonomously at each sampling interval k , starting from its own previous estimates 
of the multi-object distribution with PDFs VIgL, represented by Gaussian mixtures, and 

producing, at the end of N consensus iterations, its new consensus multi-object distribution 7rW = 7r^. 


The operations executed locally by each node i G M of the network are summarized in Table [111 
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TABLE III 

Consensus LMB Filter 

procedure Consensus LMB(Node i . Time k ) 

Local Prediction 

Local Update 
for n =» 1,..., N do 

Information Exchange 
Fusion over A/' (i) 

Merging 
end for 

Estimate Extraction 

end procedure 


> See subsection IIV-DII 

> See subsection IIV-D2I 


> See eqs. ( 37 } and jjj} 
> See (44] Table II, Section III.C] 


> See algorithm in Table |TV| 


TABLE IV 

LMB Estimate Extraction 


Input: ir k = {r k (£) ,p fe (-)h GL , N* 

Output: X* 

for c— 1, ..., N* do 

p( c ) = 5c d 7 i) n (!—y-fc(o) n^(0 

ig.f( l) £gl\j iei 

end for 

C* — arg max p(c) 

c 

L = 0 

for c* = 1,..., C* do 

L* = L* U arg max r k (£) 

£GL\L* 

end for 

X* = |(x*, £*) : t G L*, x* = arg maxp k (x, £*)| 


Similar to M5-GLMB Consensus, each node performs pruning of the components (or hypotheses) so 
as to cap their numbers. For an LMB, each component is indexed by an element of h K k J , i.e. a label. 
Hence, for LMB Consensus, at time k each node i has a density containing at most / max components 
indexed by C L 0: fc, and the weights of those components indexed by L 0: fc \L^ are set to zero. Table 
|V| summarizes the information exchanged among the nodes for both M5-GLMB and LMB trackers. 
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TABLE V 

Information exchanged at time interval k by agents i e J\f for both M^-GLMB and LMB trackers. It is 

ASSUMED THAT THE EXCHANGED INFORMATION ARE REPRESENTED WITH 4 BYTES FLOATING POINT VARIABLES. 


Tracker 

Information exchanged 

Total bytes exchanged 

M<5-GLMB 

V 7 6 ijA 1*4°, pi’\x,e; I) 

4 (l + (4 + 10)|/|) 

/ei« 

LMB 

V l £ LA r£\e), p ( k\xj) 

4(l + (4 + 10)|L«|) 


V. Performance evaluation 

To assess the performance of the proposed consensus multi-object tracking filters, we consider a 2- 
D multi-object tracking scenario over a surveillance area of 50 x 50 km 2 , wherein the sensor network 
depicted in Fig. [2] is deployed. The scenario consists of 5 objects as shown in Fig. [3] The proposed 
trackers are also compared with the Consensus CPHD filter of (27j which, however, does not provide 


tracks, and with the centralized M5-GLMB filter [39| which recursively processes all the measurements 
collected by the nodes, thus providing a performance reference for the distributed filters. 


xIO 4 



Fig. 2. Network with 7 sensors: 4 TOA and 3 DOA. 
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xIO 4 



Fig. 3. Target trajectories considered in the simulation experiment. The start/end point for each trajectory is denoted, respectively, 
by «\B. The 'A' indicates a rendezvous point. 

The kinematic object state is denoted by x = [p x , p x , p y , p y ] T , i.e. the planar position and velocity. 
The motion of objects is modeled by the filters according to the Nearly-Constant Velocity (NCV) model 
0-@: Af(x k -,Fx k -i,Q), where 
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(j w = 5 m/s 2 and the sampling interval is T s = 5 s. Objects pass through the surveillance area and 
partial prior information of the object birth locations is assumed. Accordingly, a 10-component LMB 
RFS 7Tb = {(re(£) ,pB(-,£))}£e b is used to model the birth process. Table |v| gives a detailed summary 
of such components. The aim of using such a birth process is to cover all possible locations where 
objects appear, but also locations where no objects are present or born. In this way, it is also tested the 
algorithm’s ability of ruling out possible false objects, arising in wrong birth locations, that are generated 
by clutter measurements. 

The sensor network considered in this example (see Fig. [2]) consists of 4 range-only (Time Of 
Arrival, TOA) and 3 bearing-only (Direction Of Arrival, DOA) sensors characterized by the following 
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TABLE VI 

Components of the LMB RFS birth process at a given time k 

r(£) = 0.09, pb(x , £) — Af(x\ itib(£) , Pb) 

Pb = diag(l0 6 ,10 4 ,10®, 10 4 ) 


£ 

m B {£) 

(k, i) 

[0, 0, 40000, 0] T 

(k, 2) 

[0, 0, 25000, 0] T 

(k, 3) 

[0, 0, 5000, 0] T 

(k, 4) 

[5000, 0, 0, 0] T 

(k, 5) 

[25000, 0, 0, 0] T 

(k, 6) 

[36000, 0, 0, 0] T 

(k, 7) 

[50000, 0, 15000, 0] T 

(k, 8) 

[50000, 0, 40000, 0] T 

(k, 9) 

[40000, 0, 50000, 0] T 

(k, 10) 

[10000, 0, 50000, 0] T 


measurement functions: 

( A{Px - x^) + j (py - y W )]> DOA 
h®(x) = < _ 

[ V (Px - ® (i) ) 2 + (py - y (i) ) 2 > T0A 

where ( x 0)^0 

represents the known position of sensor i. The standard deviation of DOA and TOA 
measurement noises are taken respectively as cr do A = 1° and cftoa = 100 m. Each sensor has a uniform 
clutter spatial distribution over the surveillance area. Due to the non linearity of the sensor models, the 
Unscented Kalman Filter (UKF) HD is used to update means and covariances of the Gaussian mixture 
components. 

Three different scenarios with various Poisson clutter rates A c and constant detection probabilities Pd 
are considered: 

. High SNR: A c = 5, Pd = 0.99. These parameters were used in [27] and, therefore, will be used as 
a first comparison test. 

• Low SNR: A c = 15, Pd = 0.99. These parameters emulate a realistic a scenario characterized by 
high clutter rate. 
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• Low Pd: A c = 5 , P D = 0.7. These parameters test the distributed algorithms in the presence of 
severe misdetection. 

Multi-object tracking performance is evaluated in terms of the Optimal SubPattern Assignment (OSPA) 
metric [ |52| with Euclidean distance, i.e. p = 2, and cutoff c = 600 m. The reported metric is averaged 
over 100 Monte Carlo trials for the same object trajectories but different, independently generated, clutter 
and measurement noise realizations. The duration of each simulation trial is fixed to 1000 s (200 samples). 

The Consensus M5-GLMB and the Consensus LMB filters are limited to 3000 hypotheses and are 
coupled with the parallel CPHD look ahead strategy described in [37], p8}. The CPHD filter is similarly 


limited to the same number of components through pruning and merging of mixture components 

The parameter setting used in (27) for the Consensus CPHD filter has been adopted for the present 
simulation campaigns. In particular, the survival probability is Ps — 0.99; the maximum number of 
Gaussian components is N max = 25; the merging threshold is = 4; the truncation threshold is 
7 1 — 10 -4 ; the extraction threshold is y e = 0.5; the birth intensity function is the PHD of the LMB RFS 
of Table [Vj 

N = 1 and N = 3 consensus steps have been considered for the simulations. The choice N = 1 is 
clearly the most critical one for tracking performance due to the minimal amount of information exchanged 
during consensus, but at the same time the most parsimonious in terms of data communication load. On 
the other hand, the choice N = 3 (the diameter of the network, i.e. the maximum distance between 
any two nodes in the network) allows to show the benefits of performing multiple consensus steps in 
terms of performance gain. The case N = 1 is certainly the most interesting one for comparing the 
various multi-object consensus filters as it highlights the capability of the proposed fusion technique to 
provide satisfactory results with little information exchanged and fused; the case N = 3 is interesting to 
understand how many consensus steps are needed to achieve comparable performance to the centralized 
setting (i.e. the M5-GLMB filter) where measurements from all the sensors are recursively processed by 
a single tracker. 


A. High SNR 

Figs. [4j [5] and [6] display the statistics (mean and standard deviation) of the estimated number of 
objects obtained, respectively, with the Consensus CPHD, the Consensus LMB and the Consensus M 5- 
GLMB filters. Observe that all three distributed algorithms estimate the object cardinality accurately, 
with the Consensus M5-GLMB exhibiting the best cardinality estimate (with least variance). Note that 
the difficulties introduced by the rendezvous point (e.g. merged or lost tracks) are correctly addressed by 
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all three distributed algorithms. Performing N = 3 consensus steps provides a significant improvement 
only to the cardinality estimation of the Consensus CPHD filter. 

Fig. [7] shows the OSPA distance for the three algorithms. Compared to Consensus CPHD, the improved 
localization performance of the Consensus LMB and the Consensus M5-GLMB is attributed to two 
factors: (a) the “spooky effect” (32| causes the Consensus CPHD filter to temporarily drop tracks which 
are subjected to missed detections and to declare multiple estimates for existing tracks in place of the 
dropped tracks, and (b) the two tracking filters are generally able to better localize objects due to a more 
accurate propagation of the posterior density. Note that Consensus LMB and Consensus M5-GLMB filters 
exhibit similar performance since the additional approximation in the LMB filter (see is not 

significant in high SNR. Multiple consensus steps provide a remarkable performance gain in terms of 
state estimation error. As it can be seen from Figs. 00 and [6j the cardinality is, on average, correctly 
estimated by all sensors in all Monte Carlo trials. Thus, the main contributor to the OSPA error reduction 
is the state estimation error. The object births and deaths are responsible for the peaks of the OSPA error 
in the distributed algorithms. The peaks are not present in the M5-GLMB because it makes use of all 
measurements provided by the sensors at each time interval k, while the distributed trackers only use the 
local measurements and require a few fusion steps in order to properly estimate the states of the objects. 
It is worth noticing that with N — 3 the OSPA error of the Consensus LMB and Consensus M5-GLMB 
after each peak is very close to the one of the M5-GLMB. 

B. Low SNR 

Figs. [8] and [9] display the statistics (mean and standard deviation) of the estimated number of objects 
obtained, respectively, with the Consensus CPHD and the Consensus M5-GLMB. Observe that these two 
distributed filters estimate the object cardinality accurately, with the Consensus M5-GLMB exhibiting 
again better cardinality estimate (with lower variance). 

Note that the Consensus LMB filter fails to track the objects. The problem is due to the approximation 
of the GLMB posteriors by LMBs, which becomes more severe with low SNR. In particular, each local 
tracker fails to properly capture the existence probability of the tracks due to three main factors: (a) no 
local observability, (b) high clutter rate and (c) loss of the full posterior cardinality distribution after the 
LMB approximation. Having low existence probabilities, the extraction of the tracks fails even if the 
single object densities are correctly propagated in time. 

Fig. [T0| shows the OSPA distance for the current scenario. As in the previous case study, the Consensus 
M5-GLMB filter outperforms the Consensus CPHD filter. The same conclusion as in the previous case 
(High SNR) can be drawn for multiple consensus steps. 
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C. Low Pd 

Fig. [IT] displays the statistics (mean and standard deviation) of the estimated number of objects obtained 
with the Consensus M5-GLMB. It is worth noting that in this very challenging scenario with Pd = 0.7, 
the only working distributed algorithm is indeed the Consensus M5-GLMB filter, and that it exhibits 
good performance in terms of the average number of estimated objects. Fig. [12] shows the OSPA distance 
for the current scenario. 

The benefit of using multiple consensus steps is particularly stressed by this simulation setting. As 
it can be seen from Figs. El and [12| there is a remarkable improvement in both cardinality and state 
estimation error. Further, once the peaks in the OSPA reduce, the error is comparable to the (centralized) 
M5-GLMB filter. 


VI. Conclusions 

In this paper, we have presented fully distributed multi-object tracking solutions over a sensor network 
using labeled RFSs. Consensus algorithms have been developed for fully distributed and scalable fusion 
of information collected from the multiple heterogeneous and geographically dispersed sensors. The 
proposed consensus algorithms are based on the notion of Kullback-Leibler averaging of the local multi¬ 
object probability densities. Efficient Gaussian mixture implementations have been successfully tested 
on realistic multi-object tracking scenarios. Possible topics for future work are to consider sensors with 
different field-of-view and to investigate distributed measurement-driven object initialization. 


VII. Appendix A 


Proof of Proposition [I] 

Letr/ L )(f) - J7I ieiiP^ (x ,/: L))^'"dx, and note from the definitions of w(L') and p(-,L ) in Proposition 
D] that 

n (» ( i ) (£) r < ’ > [» (1) ] 1 
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tex 


(69) 
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Using the form ( [22] ) for M5-GLMB densities we have 
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where ( [70] ) follows by substituting ( [69] ). 

Integrating applying Lemma 3 of [37, Section III.B], and noting that f p(-,£, J) dx = 1 gives 
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Dividing ( f70] ) by ( |72| ), and using ( |68] ) yields 


(70) 

(71) 


ieX J'G.TTIL) zGX 


(72) 


n (- (i) ( x 

iex 




j(0 


= A(X)uJ(£(X))[p(-;AX))] 


x 


/ n (- ( °( x ) ^ 

^ iGX 

which is an M5-GLMB with parameter set {(w(L) ,]?(•; ^))}lg7(l)- Finally, using the equivalence 
between the KLA and the normalized geometric mean in Theorem 1 completes the proof. 


Proof of Proposition [2} 
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Note from the definitions of r{t) and p(x,£) in Proposition [2] that 
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Using the form ([25]) for LMB densities we have 
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where the substitutions {76]), ( [74] ) and ( [75] ) have been performed. 

Integrating (78), applying Lemma 3 of [37, Section III.B] and noting that f p(x, -)dx = 1 gives 
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where in the last step we applied the Binomial Theorem [53| 
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Dividing {78]) by {79]), and using {77]) yields 
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which is an LMB with parameter set {(r(£) ,p(£))}ee: Finally, using the equivalence between the 
KLA and the normalized geometric mean in Theorem [T] completes the proof. 
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Fig. 4. Cardinality statistics for Consensus CPHD filter under high SNR. 



Fig. 5. Cardinality statistics for Consensus LMB tracker under high SNR. 
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Fig. 6. Cardinality statistics for Consensus M<5-GLMB tracker under high SNR. 
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Fig. 7. OSPA distance (c = 600 [m], p = 2) under high SNR. 
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Fig. 8. Cardinality statistics for Consensus CPHD filter under low SNR. 



Fig. 9. Cardinality statistics for Consensus M^-GLMB tracker under low SNR. 
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Fig. 10. OSPA distance (c = 600 [m], p = 2) under low SNR. 
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Fig. 11. Cardinality statistics for Consensus M5-GLMB tracker under low Pd- 



Fig. 12. OSPA distance (c = 600 [m], p = 2) under low Pd- 































